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DETAILED ACTION 

1 . This communication is responsive to amendment filed 07/12/2004. 

2. Claims 1-32 are pending in this application. Claims 1-8, 12, 14, 17, 18, 22, 24 and 27 are 
independent claims. In the amendment, no claim is canceled, no claim is amended, and claims 
28-32 are added. This action is made non-final. 

Claim Rejections - 35 USC §103 

3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

4. Claims 1-9 and 12-32 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Koba (US 6,222,947) in view of Johnson (US 2001/0019630). 

As per independent claim 1, Koba teaches a digital image album layout system 
comprising: 

a page creator module having a first program algorithm operable to execute calculations 
on a first population of image criteria, said page creator module having a page evaluation module 
operable to test said first population for fitness to album preference criteria (col. 6, lines 43-59) 
and 

an image placement module having a second program algorithm operable to execute 
calculations on a second population of page layout criteria, said image placement module having 
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a layout evaluation module operable to test said second population for fitness to page preference 
criteria (col. 7, lines 37-41). 

Koba does not disclose the first program algorithm and the second program algorithm to 
implement genetic programming technique. Johnson discloses genetic programming method is 
used for image classification basing on a variety of image types (pages 14 and 15, [0212]- 
[023 1]). It would have been obvious to an artisan at the time of the invention to use the teaching 
from Johnson of applying genetic programming in Koba's system since the advantages of the 
Genetic Programming approach include its robustness to changing environment, its low demand 
for data, and its computational speed. 

As per independent claim 2, Koba teaches an automated album layout method responsive 
to a set of inputs containing digital images, graphics, and other 2-dimensional objects, 
comprising the steps of: 

evaluating a grouping of the image objects for distribution into a number of album pages 
according to a fitness function's parameters of a program algorithm (col. 6, lines 43-59); 

assigning each image object to a page based on user preferences, including balance (col. 
6, line 52 - col. 7, line 13); 

displaying said page for user viewing, and refining the distribution based on further user 
action (S210 of fig. 4 and fig. 5C and 5G). 

Koba does not disclose the program algorithm to implement genetic programming 
technique. Johnson discloses genetic programming method is used for image classification 
basing on a variety of image types (pages 14 and 15, [0212]-[0231]). It would have been obvious 
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to an artisan at the time of the invention to use the teaching from Johnson of applying genetic 
programming in Koba's system since the advantages of the Genetic Programming approach 
include its robustness to changing environment, its low demand for data, and its computational 
speed. 

As per independent claim 3, Koba teaches an automated layout and presentation method 
responsive to a set of inputs containing digital images, graphics, and other two-dimensional 
objects, comprising the steps of: 

evaluating the V and y' position coordinates, scale, and rotation of each of the input 
images objects within a page according to fitness function parameters in a program algorithm 
(col. 7, lines 37-41); 

creating a page layout based on user preferences including rotation (col. 7, lines 37-41); 

displaying said page layout for user viewing; refining said page layout based on further 
user action (S210 of fig. 4 and fig. 5C and 5G), and formatting the page layout printing (col. 8, 
lines 12-14). 

Koba does not disclose the program algorithm to implement genetic programming 
technique. Johnson discloses genetic programming method is used for image classification 
basing on a variety of image types (pages 14 and 15, [0212]-[0231]). It would have been obvious 
to an artisan at the time of the invention to use the teaching from Johnson of applying genetic 
programming in Koba's system since the advantages of the Genetic Programming approach 
include its robustness to changing environment, its low demand for data, and its computational 
speed. 
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As per independent claims 4, 5, and 6, they are rejected under the same rationale as claim 

1. 

As per independent claim 7, it is rejected under the same rationale as claim 4. 

As per independent claim 8, Koba teaches a method of assigning a plurality of images, 
having image parameters, to one or more pages in an album, comprising the steps of: 

specifying an initial set of page assignments defining the album page assignment for each 
of the plurality of images; initializing a population by assigning said initial set of page 
assignments to genes within an album genome structure (col. 6, lines 43-45); evolving said 
population in accordance with a program algorithm to produce a present set of page assignments 
within said album genome structure (col. 6, lines 45-54); 

calculating a present set of page criteria according to said present set of page 
assignments, the image parameters, and a set of album page parameters; testing said present set 
of page criteria according to an album fitness function to determine an album score; repeating 
said evolving and calculating steps if said album score fails to meet an album threshold value, 
and outputting image page assignments according to said present page assignment if said album 
score meets said album threshold value (col. 6, line 55 - col. 7, line 19). 

Koba does not disclose the program algorithm to implement genetic programming 
technique. Johnson discloses genetic programming method is used for image classification 
basing on a variety of image types (pages 14 and 15, [0212]-[0231]). It would have been obvious 



Application/Control Number: 09/750,858 Page 6 

Art Unit: 2179 

to an artisan at the time of the invention to use the teaching from Johnson of applying genetic 
programming in Koba's system since the advantages of the Genetic Programming approach 
include its robustness to changing environment, its low demand for data, and its computational 
speed. 

As per claim 9, which is dependent on claim 8, Koba teaches the image parameters 
include an image event value, image chronology value, and image emphasis value (col. 6, lines 
7-42). 

As per independent claim 12, Koba teaches a method of assigning a plurality of images, 
having image parameters, to one or more pages in an album, comprising the steps of: 

specifying an initial set of page assignments defining the album page assignment for each 
of the plurality of images; initializing a population by assigning said initial set of page 
assignments to genes within an album genome structure (col. 6, lines 43-45); evolving said 
population in accordance with a program algorithm to produce a present set of page assignments 
within said album genome structure (col. 6, lines 45-54); 

calculating a present set of page criteria according to said present set of page 
assignments, the image parameters, and a set of album page parameters; testing said present set 
of page criteria according to an album fitness function to determine an album score; repeating 
said evolving and calculating steps if said album score fails to meet an album threshold value, 
and outputting image page assignments according to said present page assignment if said album 
score meets said album threshold value (col. 6, line 55 - col. 7, line 19); 
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Koba does not disclose the program algorithm to implement genetic programming 
technique includes a genetic mutation function and a genetic crossover function. Johnson 
discloses genetic programming method is used for image classification basing on a variety of 
image types (pages 14 and 15, [0212]-[0231]). It would have been obvious to an artisan at the 
time of the invention to use the teaching from Johnson of applying genetic programming in 
Koba's system since the advantages of the Genetic Programming approach include its robustness 
to changing environment, its low demand for data, and its computational speed. 

As per claim 13, which is dependent on claim 8, Koba teaches calculation of said page 
criteria includes calculation of an emphasis value range, a page count value, and a balance 
threshold value (col. 6, line 55 - col. 7, line 19). 

As per independent claim 14, Koba teaches a method of assigning a plurality of images, 
having image parameters, to one or more pages in an album, comprising the steps of: 

specifying an initial set of page assignments defining the album page assignment for each 
of the plurality of images; initializing a population by assigning said initial set of page 
assignments to genes within an album genome structure (col. 6, lines 43-45); evolving said 
population in accordance with a program algorithm to produce a present set of page assignments 
within said album genome structure (col. 6, lines 45-54); 

calculating a present set of page criteria according to said present set of page 
assignments, the image parameters, and a set of album page parameters; testing said present set 
of page criteria according to an album fitness function to determine an album score; repeating 
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said evolving and calculating steps if said album score fails to meet an album threshold value, 
and outputting image page assignments according to said present page assignment if said album 
score meets said album threshold value (col. 6, line 55 - col. 7, line 19); 

wherein said testing step further comprises the steps of: comparing said page criteria to 
preference criteria and generating a preliminary album score and scaling said preliminary album 
score in accordance with album importance parameters to produce a final album score (col. 6, 
line 55 -col. 7, line 19). 

Koba does not disclose the program algorithm to implement genetic programming 
technique. Johnson discloses genetic programming method is used for image classification 
basing on a variety of image types (pages 14 and 15, [0212]-[0231]). It would have been obvious 
to an artisan at the time of the invention to use the teaching from Johnson of applying genetic 
programming in Koba's system since the advantages of the Genetic Programming approach 
include its robustness to changing environment, its low demand for data, and its computational 
speed. 

As per claim 15, which is dependent on claim 8, Koba teaches the page criteria includes 
balance, emphasis, chronology, and unity (col. 6, lines 7-42 and col. 6, line 55 - col. 7, line 19). 

As per claim 16, Koba teaches the preference criteria are based upon user preferences 
(col. 3, lines 56-61). 

As per independent claim 17, it is rejected under the same rationale as claim 1. 
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As per independent claim 18, Koba teaches a method of arranging one, or more images, 
having image parameters, on an album page, comprising the steps of: 

specifying an initial set of positioning parameters for each of the one or more images; 
initializing a population by assigning said initial set of positioning parameters as genes in a page 
genome structure; evolving said population in accordance with a program algorithm to produce a 
present set of positioning parameters within said page genome structure (col. 7, lines 20-36); 

calculating a set of present layout criteria, according to said present set of positioning 
parameters, the image parameters, and a set of page layout parameters; testing said present set of 
layout criteria according to a page fitness function to determine a page score; repeating said 
evolving and calculating steps if said page score fails to meet a page threshold value (col. 7, lines 
37-47); and 

outputting a page layout according to said present set of positioning parameters if said 
page score meets said page threshold value (col. 8, lines 1-14). 

Koba does not disclose the program algorithm to implement genetic programming 
technique. Johnson discloses genetic programming method is used for image classification 
basing on a variety of image types (pages 14 and 15, [0212]-[0231]). It would have been obvious 
to an artisan at the time of the invention to use the teaching from Johnson of applying genetic 
programming in Koba' s system since the advantages of the Genetic Programming approach 
include its robustness to changing environment, its low demand for data, and its computational 
speed. 
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As per claim 19, which is dependent on claim 18, Koba teaches the image parameters 
include an image emphasis value (col. 7, lines 20-36). 

As per claim 20, which is dependent on claim 18, Koba teaches the genome structure is 
an array (the layouts of pictures as in fig. 5F, for example, are arrays). 

As per claim 21, which is dependent on claim 18, this claim is rejected under the same 
rationale as claim 20. 

As per independent claim 22, Koba teaches a method of arranging one, or more images, 
having image parameters, on an album page, comprising the steps of: 

specifying an initial set of positioning parameters for each of the one or more images; 
initializing a population by assigning said initial set of positioning parameters as genes in a page 
genome structure; evolving said population in accordance with a program algorithm to produce a 
present set of positioning parameters within said page genome structure (col. 7, lines 20-36); 

calculating a set of present layout criteria, according to said present set of positioning 
parameters, the image parameters, and a set of page layout parameters; testing said present set of 
layout criteria according to a page fitness function to determine a page score; repeating said 
evolving and calculating steps if said page score fails to meet a page threshold value (col. 7, lines 
37-47); and 

outputting a page layout according to said present set of positioning parameters if said 
page score meets said page threshold value (col. 8, lines 1-14). 
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Koba does not disclose the program algorithm to implement genetic programming 
technique includes a genetic mutation function and a genetic crossover function. Johnson 
discloses genetic programming method is used for image classification basing on a variety of 
image types (pages 14 and 15, [0212]-[023 1]). It would have been obvious to an artisan at the 
time of the invention to use the teaching from Johnson of applying genetic programming in 
Koba's system since the advantages of the Genetic Programming approach include its robustness 
to changing environment, its low demand for data, and its computational speed. 

As per claim 23, which is dependent on claim 18, Koba teaches the layout criteria 
includes calculation of image rotation (col. 6, lines 8-20 and col. 7, lines 37-41). 

As per independent claim 24, Koba teaches a method of arranging one, or more images, 
having image parameters, on an album page, comprising the steps of: 

specifying an initial set of positioning parameters for each of the one or more images; 
initializing a population by assigning said initial set of positioning parameters as genes in a page 
genome structure; evolving said population in accordance with a program algorithm to produce a 
present set of positioning parameters within said page genome structure (col. 7, lines 20-36); 

calculating a set of present layout criteria, according to said present set of positioning 
parameters, the image parameters, and a set of page layout parameters; testing said present set of 
layout criteria according to a page fitness function to determine a page score; repeating said 
evolving and calculating steps if said page score fails to meet a page threshold value (col. 7, lines 
37-47); and 
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outputting a page layout according to said present set of positioning parameters if said 
page score meets said page threshold value (col. 8, lines 1-14). 

wherein said testing step further comprises the steps of: comparing ^said layout criteria to 
layout preference criteria and generating a preliminary page score and scaling said preliminary 
page score in accordance with page importance parameters to produce a final page score (col. 8, 
lines 1-14). 

Koba does not disclose the program algorithm to implement genetic programming 
technique. Johnson discloses genetic programming method is used for image classification 
basing on a variety of image types (pages 14 and 15, [0212]-[0231]). It would have been obvious 
to an artisan at the time of the invention to use the teaching from Johnson of applying genetic 
programming in Koba's system since the advantages of the Genetic Programming approach 
include its robustness to changing environment, its low demand for data, and its computational 
speed. 

As per claim 25, which is dependent on claim 18, Koba teaches the page criteria include 
white space range (col. 6, lines 8-20 and col. 7, lines 37-41). 

As per claim 26, Koba teaches the layout preference criteria are based upon user 
preferences (col. 3, lines 56-61). 

As per independent claim 27, it is rejected under the same rationale as claim 1. 
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As per claim 28, Koba teaches repeating said evolving and testing steps if said album 
score fails to meet said album threshold value (col. 6, line 55 - col. 7, line 19). 

As per claim 29, since Koba's program algorithm implements Johnson's genetic 
programming technique (Johnson, pages 14 and 15, [0212]-[0231]), it is inherent in genetic 
programming to have the genetic evolution calculations performed by at least one of the first and 
second genetic engines include the application of a genetic mutation function. 

As per claim 30, since Koba's program algorithm implements Johnson's genetic 
programming technique (Johnson, pages 14 and 15, [0212]-[0231]), it is inherent in genetic 
programming to have the genetic evolution calculations performed by at least one of the first and 
seeond genetic engines include the application of a genetic crossover function. 

As per claim 31, since Koba's program algorithm implements Johnson's genetic 
programming technique (Johnson, pages 14 and 15, [0212]-[023 1]), it is inherent in genetic 
programming to have the step of evolving said genetic population includes the application of a 
genetic mutation function. 

As per claim 32, since Koba's program algorithm implements Johnson's genetic 
programming technique (Johnson, pages 14 and 15, [0212]-[0231]), it is inherent in genetic 
programming to have the step of evolving said genetic population includes the application of a 
genetic crossover function. 
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Claim Rejections - 35 USC §103 

5. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

6. Claims 10 and 1 1 are rejected under 35 U.S.C. 103(a) as being unpatentable over Koba in 
view of Johnson and further in view of Wang (US 6,014,458). 

As per claim 10, which is dependent on claim 8, Koba in view of Johnson does not 
disclose the genome structure is a tree structure. Wang discloses hierarchical tree structure for 
arranging images in document pages in and fig. 8, lines 27-45. It would have been obvious to an 
artisan at the time of the invention to use the teaching from Wang of the genome structure is a 
tree structure in modified Koba's system since it would allow a user to easily arrange and 
organize images in pages. 

As per claim 1 1, which is dependent on claim 8, it is rejected under the same rationale as 
claim 10, 

Response to Arguments 

7. Applicant's arguments with respect to claims 1-11, 13, 15, 17-21, 23, 25 and 27 have 
been considered but are moot in view of the new ground(s) of rejection. 
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Inquiries 

8. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Nhon (Gary) D Nguyen whose telephone number is (571)272- 
4139. The examiner can normally be reached on Monday - Friday with every other Monday off. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Heather R Herndon can be reached on (571)272-4136. The fax phone number for the 
organization where this application or proceeding is assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 

i 

Nhon (Gary) Nguyen I 
November 12, 2004 / 



